Figure 1-A 



Originating server and caching proxy server (CP) 
negotiate, through real-time streaming protocol 

(RTSP) for server to send and CP server to receive 
streaming media data (For example: QuickTime 
Streaming Audio Data). 



CP server receives streaming media data, using real 
time transfer protocol (RTP), in streaming media 
format not the same format as stored on originating 
server and CP server stores the streaming media data, 
in the streaming media format, on a storage device 
controlled by CP server. 



CP server receives request, through RTSP, from a 
client for the streaming media data and retrieves the 
data from the storage device and transmits the 
streaming media data to the client system. 
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CP asks SETUP in RTSP 
For Audio data and specifies 
extensions to RTP data 
for audio data 
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Server Responds / Negotiates 
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CP asks SETUP in RTSP 
For Video data and specifies 
extensions to RTP data 
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Server Responds / Negotiates 



CP asks PLAY in RTSP 
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Server responds with RTP data 
for all tracks with negotiated 
extensions 
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CP asks for transmit time 
information from the server 



Server receives the request for 
Transmit time (TT) 



- Extensible header format is a 
sub-extension containing a sub- 
extension ID, identifying the 
content of the information. 

- TT sub-extension also 
contains a single 64-bit 
unsigned integer representing 
recommended transmission 
time of RTP packet in 
milliseconds 
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CP gets the TT data, removes 
extension header and stores the 
data locally; TT times are 
associated with appropriate 
streaming data 



Client requests streaming data 
by making a PLAY request in 
RTSP 
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Server responds and sends TT 
identifier code, which 
corresponds, to TT type of 
extension, in an extensible 
header format - Streaming data 
is sent with TT extended data 



Server does not respond to 
request. This indicates that 
Server does not support the 
extension requested 



CP may terminate process 
If TT is critical element 
of the CP operation 
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Client may also 
ask for PLAY or 
other data directly 
from server 



CP responds and sends tracks of data at appropriate times 
specified by TT times associated with streaming data 
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Client PLAYS data 



CP asks for frame type 
information from the server 



Server receives the request for 
Frame tvoe (FT) 



Server responds and sends FT 
identifier code, which 
corresponds, to FT type of 
extension, in an extensible 
header format - Streaming data 
is sent with FT extended data 



- Extensible header format is a 
sub-extension containing a sub- 
extension ED, identifying the 
content of the information. FT 
sub-extension also contains 16- 
bit unsigned integer value with 
well-known frame types such as 
0-unknown frame, 1-key frame, 
2-b frame, and 3-p frame. Future 
versions can add more frames. 
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CP gets the FT data, removes 
extension header and stores the 
data locally; FT frames are 
associated with appropriate 
streaming data 
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CP reviews client request Stops 
sending least important frames 
and sends only higher 
importance frames 
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Server does not respond to 
request. This indicates that 
Server does not support the 
extension requested 



CP may terminate process 
If FT is critical element 
of the CP operation 
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Client informs CP that it is 
overloaded with information 
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Client may also 
ask for FT or 
other data directly 
from the server 
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CP asks by name for one or more RTP 
sub-extensions using RTSP protocol 



Server responds back to CP indicating its 
support for the requested sub-extensions. 

Server also transmits to CP an identifier (e,g 
number code) corresponding to each name 

of RTP extension. CP may later use the code 
when receiving extended data. Response 
may or may not be a complete response. 
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CP receives server's response 



CP determines whether server responded 
to all requested sub-extensions 
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CP requests Server to send all , ^ s - / ^ 2- ^ 



supported streaming media data 
associated the RTP sub-extensions 



Server sends all supported RTP sub- 
extensions and streaming media data 
associated with the RTP sub- 
extensions 



Are any of the missing sub- 
extensions critical to CP 
processes? 



CP stores sub-extension data and 
streaming media associated with the 
RTP sub-extension locally 



CP may remove sub-extension fields 
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CP decides whether 
to terminate 
operations 



CP evaluates client requests and 
performs functions accordingly. 
For example frame thinning or using 
transmit time optionally to transmit 
data 



CP sends streaming media data to client 
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